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© Method and system for providing closed loop color control between a scanned color image and 
the output of a color printer. 



© A method and system for continuously correct- 
ing for errors in color output of a color copier or 
printer (18) and caused by events that occur be- 
tween the input of a color image scanner (10) and 
the output of a copier or printer (18) driven thereby. 
This method and system includes, among other 
things, the continuous comparison (40) of input test 
pattern data, TP in , from a small color gamut (Fig. 6. 
30) or "patch" having only a selected few number of 
color pixels therein with the output test pattern data, 
TP out , from a color printer (18) or copier to generate 

IO 



(40) a color correction conversion factor, H. Then, H 
is used to continuously update (42, 86) an initial full 
scale look up table which was initially prepared from 
a full scale color gamut (Fig. 5). The initial look up 
table (28) has a color conversion factor, F 0 id» and H 
is used to convert F 0 ia to F ne w where F new = H • Fo, d 
In this manner (84), H continuously corrects for 
undesirable changes in parameters used to generate 
the initial look up table (28), such as quality of print 
media, ink, dye loading, ink drop volume, pen types 
and the calibration of system devices. 
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Technical Field 



This invention relates generally to color correc- 
tion techniques used in digital color printing and 
more particularly to improving the color print qual- 
ity of color printers and color copiers. The present 
invention provides a method and means for con- 
tinuously matching the color output of a color print- 
er with the color of an image read by a scanner 
which feeds the printer. 



Background Art 



drop volume. Furthermore, the above color mis- 
match or distortion will also be caused by changes 
in calibration which may occur over time to the 
separate calibration systems which are, respec- 
5 tively, part of the image scanner and a densitom- 
eter which is used to convert the color gamut into 
its R.G, & B components. 

One solution to the above problem of color 
mismatch is to continuously update the full color 
70 gamut every time there is a change in one of the 
above five print parameters or in the calibrations of 
the scanner and densitometer. However, such a 
continuous updating of the large scale color gamut 
is very expensive and time consuming for reasons 
15 described in more detail below. 



In the fields of color copying and color printing, 
it is known to convert red. blue, and green (R.B.G) 
output data from a scanner into corresponding 
cyan, yellow, magenta and black (C,Y,M,K) data 
and then to further process and refine this C.Y.M.K 
data before using same to drive a color printer. 
One such conversion system is described, for ex- 
ample, in co-pending application Serial Number 
278,881 of C. S. Chan et al entitled "Method and 
System For Enhancing the Quality of Both Color 
and Black and White images Produced by Ink Jet 
Printers", assigned to the present assignee and 
incorporated fully herein by reference (European 
Application No. 89312460.2). Other related types of 
color conversion systems are disclosed in Clark et 
al U.S. Patent 4.477.833. Yoshida et al U.S. Patent 
4.719.490. and Myers U.S. Patent 4,751,490, all 
incorporated herein by reference. 

Using the color conversion technique described 
and claimed in my above co-pending application, it 
becomes necessary to employ a large and com- 
plete color gamut in order to generate a data bank 
or memory known as a "look up table" or LUT. 
This look up table is in turn stored in the memory 
of a computer and then used by the computer for 
converting the received red, blue, and green data 
to cyan, magenta, yellow, and black data which is 
in turn used to drive a color printer. This complete 
color gamut should be prepared on the same type 
of print media and using the same type of ink, pen, 
drop volume and dye loading as is expected to be 
used by the color printer or copier under control of 
an image scanner. This operation is necessary in 
order to provide the best possible color match 
between the hardcopy output of the color printer 
and the scanned color image which is converted to 
C.Y.M & K data for driving the color printer. A color 
mismatch or color distortion will occur between the 
colors in the scanned image and the colors in the 
hardcopy output of the color printer when there is a 
change over time in any one of the above original 
parameters of print media, ink, dye, pen type, or 



Disclosure of Invention 

20 

Accordingly, it is an object of the present in- 
vention to provide an improved and relatively in- 
expensive method and system for providing good 
color match between the image read by a color 
25 scanner and the hardcopy output of a color printer 
or copier controlled thereby. 

Another object is to provide a new and im- 
proved method and system of the type described 
which does not require continuous updating of a 
30 large color gamut and the computational expenses 
associated therewith. 

Another object of this invention is to provide a 
new and improved method and system of the type 
described which is readily adaptable to incorpora- 
35 tion into existing color copiers and printers and 
which may be used with various types of printers 
such as thermal ink jet printers, thermal printers, 
electrostatic printers and the like. 

These and other objects and attendant advan- 
40 tages of this invention are accomplished by the 
provision of a method and system of color correc- 
tion wherein initially a large color gamut is pre- 
pared and utilized to generate an initial look up 
table for storage into the memory of a computer. 
45 This look up table is based upon a preselected 
print medium, ink, dye loading, pen type, and drop 
volume. A pre-generated test pattern, TP in , derived 
from a small chosen color gamut is then fed 
through a scanner which is operative to generate 
so R,G,B output data. This R.G.B output data is in turn 
fed to the above computer where the above look 
up table converts it to C.Y.M.K data and processes 
this C.Y.M.K data to a color printer using standard 
error diffusion and pixel assignment procedures 
55 such as those described in my above identified 
copending application or other order dither meth- 
ods. The output data of the color printer is des- 
ignated as TPout. and this output test pattern TP ou t 
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is fed back to the scanner to generate another set 
of R.G.B data. Then, using standard mathematical 
conversion procedures, a conversion factor, H. is 
obtained in accordance with the relationship: 
Equation 1: TP ln = H • TP ou t 
where H is a matrix mapping function used for 
mapping TP out to TP in . 

The sequence of steps of this novel method 
embodying my invention includes providing a full 
scale color gamut based upon preselected param- 
eters such as print media, inks, dyes, drop vol- 
umes and pen types; constructing an initial look up 
table based upon this full scale color gamut; stor- 
ing this initial look up table in a computer, compar- 
ing a sample test pattern of input information. TP,„, 
read from a small color gamut or "patch" by a 
color image scanner with a test pattern of output 
information, TP 0Ull generated by a color printer; 
generating a corresponding correction factor, H, as 
defined by Equation 1 above; and then using this 
correction factor H to continuously update the initial 
look up table which is stored in a computer mem- 
ory. In this manner, the color differences between 
the image scanned by the image scanner and the 
hardcopy output of a color printer are always mini- 
mized. 

The above objects and other advantages and 
unique features of this invention will become better 
understood with the reference to the following de- 
scription of the accompanying drawings. 



Brief Description of the Drawings 

Fig. 1 is a functional block diagram of one 
type of image conversion system in which the 
present invention may be incorporated. 

Fig. 2 is a flow chart depicting the data 
processing methodology for practicing the present 
invention. 

Fig. 3 is a functional block diagram cor- 
responding to steps 20.22.24.26 and 28 in Fig. 2. 

Fig. 4 functionally illustrates a data process- 
ing system for carrying out the steps of Fig. 1 and 
which can be implemented by those skilled in the 
art using existing off-the-shelf electronic products 
commercially available in the image processing 
and printer fields of technology. 

Figs. 5 and 6 are large and small color 
gamuts, respectively, which are typical of those 
useful in practicing the invention. 

Description of the Preferred Embodiment 



Referring now to Fig. 1, the image conversion 
system shown herein is of the type described in 



my above copending application serial no. 278,881 
and is just one type of system with which the 
present invention may be used. In this system in 
Fig. 1 a scanner 10 is used to convert a color 

5 image into digital gray scale data for application to 
an additive red-green-blue (R-G-B) format conver- 
sion stage 12. The R-G-B output data from the 
format conversion stage 12 is applied as indicated 
to the subtractive color primaries cyan-yellow-ma- 

w genta (C-Y-M) color conversion stage 14 in a well 
known manner and including 100% undercolor re- 
moval to obtain black. A chromatic color (black) 
cannot be easily made by mixing Y-M-C ink colors, 
and such mixing will increase the amount of ink 

75 consumed. Therefore, the black created by Y.M.C 
colors is preferably replaced by pure black (K). 
This replacement and the generation of pure black 
is known in the art as undercolor removal (UCR). 
The use of 100% undercolor removal is for the 

20 purpose of minimizing ink consumption and to im- 
prove resolution. The equation for 100% UCR for 
colors C, M, Y and K is K = min (C. M. Y) where 
the new C = C-K. the new M = M-K and the new 
Y = Y-K. 

25 The output of the C-Y-M color conversion stage 

14 is a digital data stream which is applied to the 
error diffusion and pixel assignment stage 16, and 
the latter stage 16 in turn drives a color printer 18, 
preferably a thermal ink jet color printer. The gen- 
30 era! functional arrangement of the image scanning 
and color reproduction system of Fig. 1 is well 
known in the image processing art. The image 
processing operation and capability of such a sys- 
tem is described, for example, in the March 1987 
35 issue of BYTE Magazine in an article by B. M. 
Dawson entitled "Introduction To Image Processing 
Algorithms" at page 169 et seq. Such image pro- 
cessing capability and corresponding system op- 
eration is also described in a publication by Gary 
40 Dispoto et al entitled Designer's Guide to Raster 
Image Printer Algorithms . First Edition. December 
1986. Copyrighted by and available from the 
Hewlett-Packard Company in Palo Alto. California. 
Both of these latter references are incorporated 
45 herein by reference. 

The processes of error diffusion and pixel as- 
signment in stage 16 of Fig. 1 in a gray scaling 
image processing operation are also generally well 
known in this art. Error diffusion is a technique 
so used to disperse to the neighboring pixels the error 
between a printable gray scale and the input image 
gray scale data. This error diffusion has been fre- 
quently carried out using a selected one of many 
well known algorithms such as those discussed in 
55 the above identified Dawson article. As an example, 
this error diffusion may be carried our using either 
one of two well known algorithms in this art, name- 
ly. Floyd and Steinberg's 4-point algorithm and 
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Stucki's 12-point algorithm. 

Referring now to Fig. 2. this figure will be 
described in terms of sequential signal processing 
steps, including providing a complete color gamut 
at step 20, and this color gamut may consist typi- 
cally of up to 200 color patches arranged in an X-Y 
matrix. This complete color gamut is shown in Fig. 
5 herein and is read by a densitometer at step 22 
to in turn generate filtered red, green, and blue 
data at step 24. This data from step 24 is then 
programmed at step 26 into either a separate com- 
puter or a computer located within a color printer 
where it is used to generate a look up table at step 
28. A comprehensive color gamut is required here 
to adequately cover the entire color space when 
generating the initial look-up table for storage into 
computer memory. 

A simplified test pattern such as the one shown 
in Fig. 6 herein is provided as indicated at step 30 
and may include, for example, a 4x6 matrix of 
R,G.B patches and C,Y,M patches arranged in ad- 
jacent rows and columns. The simplified test pat- 
tern ("patch") provided in step 30 is scanned using 
a conventional color scanner at step 32 to in turn 
generate R.G.B input test pattern (TP in ) data for 
application to a computer. The TP in data from step 
32 is then processed through the initial look up 
table previously stored in a computer memory to 
generate corresponding C,M,Y and K output data 
as indicated at step 34. The C.M.Y and K data in 
step 34 is related to the R.G.B data by a first 
transformation matrix or conversion factor, F, and 
the data from step 34 is applied to a color printer 
to generate output test pattern data, TP outl at step 
36. The test pattern output data TP 0Ul at step 36 is 
then fed back to the same scanner that is used in 
step 32 above and is further used in step 38 to 
generate corresponding output R,G,B data from the 
color scanner and representative of TP 0U t- The 
TPout data from the color scanner in step 38 is then 
applied to the computer at step 40 where TP otl t 
R,G,B data is compared therein to TP in R,G,B data 
to in turn generate a compensation matrix H. This 
compensation matrix is also referred to herein as a 
second transformation matrix or second conversion 
factor, H, and is defined in Equation 1 above. 

The second transformation matrix, H, is then 
mathematically merged in step 42 with the pre- 
viously identified first transformation matrix or con- 
version factor F to generate a new updated color 
look up table to be stored in either a separate 
computer or a computer which is located in a color 
printer or color copier. 

The computational effort, e.g. time, for generat- 
ing the first transformation matrix or conversion 
factor. F, used to obtain the above R.G & B compo- 
nents for the initial look up table depends upon the 
dimensions of the full scale color gamut in Fig. 5. 



To a first order approximation, this computational 
effort is proportional to N 3 , where N is the number 
of patches in the color gamut. For example, in 
generating the conversion factor F for a 20x20 
5 patch matrix. N will be 20x20 or 400 and N 3 will 
equal 64 X 10 6 floating point operations. However, 
in generating the second transformation matrix, H, 
the dimension of the input vector N is 24 for 6X4 
color patches; hence N 3 = 13.824 floating point 
70 operations. In the above example, not only is there 
provided a substantial saving in computational cost, 
but in addition a significant amount of time is saved 
in preparing the color gamut input data TP in . This 
updating procedure continuously corrects for the 
75 drifting in the calibration of the equipment used as 
well as changes in the parameters of ink, pen, 
paper, drop volume, dye loading or other similar 
parameters that may change over time. The use of 
the smaller 4X6 color gamut (Fig. 6) is sufficient for 
20 use in the updating process inasmuch as most of 
the correct color information is already present in 
the then-existing color look up table, and only 
minor color corrections are needed. Furthermore, 
all of the major colors of the full color gamut color 
25 space are present in the 4X6 color patch matrix in 
Fig. 6 and are quite sufficient for use in the present 
continuous updating error correction process and 
provide excellent scanned image-to-hardcopy out- 
put color match. 
30 Referring now to Fig. 3 which shows the func- 

tional relationship between the complete color 
gamut, densitometer and memory for storing the 
initial LUT, a complete color gamut 44 is read by a 
densitometer 46 to convert the cyan, magenta and 
35 yellow information of all of the pixels of the color 
gamut to red, green and blue information. The 
mathematical relationship of mapping the RGB in- 
formation into CMY information is shown in stage 
48, and this mapping function is stored in the 
40 computer memory of stage 52 as a look up table. 

Referring now to Fig. 4, as previously indi- 
cated, a color image scanner 54 is positioned and 
connected to receive red, green & blue data at a 
first input line 56 from a small simplified test pat- 
45 tern 58 consisting, for example, of a 6X4 matrix of 
R.G.B patches and C.Y.M.K patches arranged in 
adjacent rows and columns and shown in Fig. 6 
hereof. The simplified test pattern or patch 58 is 
scanned by the scanner 54 to generate R.G.B input 
so test pattern data, or TP in data, on the output 60 and 
applied to the memory stage 52 in the computer 
62. This R.G.B data labeled TP, n is also applied by 
way of line 64 to one input connection of a trans- 
formation or conversion algorithm stage 66. 
55 The color scanner 54 is also connected to 

receive the output test pattern data, TP 0Ut , in the 
feedback path 68 from the output of the color 
printer 70 and which is connected as a second 
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input line feeding the scanner 54. 

The memory stage 52 corresponds to the 
same numbered stage in Fig. 3 and is part of either 
a general purpose or special purpose computer 62 
which also includes a continuously updated look up 
table 72. The output of the LUT 72 is connected to 
an error diffusion or order dither stage 74, and the 
output line 76 of stage 74 is connected to drive the 
color printer 70. The color printer 70 may, for 
example, include an input pixel assignment stage 
78 which drives a nozzle firing stage 80 operative 
for generating R.G.B output test pattern data, 
TPUout. on output line 68 as shown. 

The color scanner 54 continuously scans the 
TPout data for determining color variations therein 
and in turn generates this TP out data on line 82 
which is applied as a second input signal to the 
transformation algorithm stage 66. The transforma- 
tion algorithm in stage 66 is used to thus continu- 
ously update the first conversion factor F 
(generated from the initial look up table) by provid- 
ing the second conversion factor, H. Thus, F is 
continuously updated in stage 84 to F new by the 
relationship F new = H • F old . The continuously 
updated new conversion factor, F new . as indicated 
at the output of stage 84 is provided as input data 
to an updated color look up table in stage 86, 
where stages 66, 84 and 86 are all part of a second 
general purpose or special purpose computer 88. 
The output signal on line 90 from the updated color 
look up table in stage 86 is thus continuously 
applied as an input signal to a storage or memory 
device 92 as indicated in Fig. 4 and is used to 
continuously match the color of the hardcopy out- 
put with the color of the scanned image input to 
the color scanner 54. The storage device 92 can 
be the same as the memory stage 52. 

The conversion factors F & H are matrix quan- 
tities defined by a plurality of polynomials repre- 
sentative of C, Y and M data within each scanned 
pixel of a color gamut. These matrix quantities are 
used to map the R,G,B density information into the 
C.M.Y color space, and are described in some 
detail in a paper by F.R. Clapper entitled "An 
Empirical Determination of Halftone Color-Repro- 
duction Requirements", Technical Association of 
the Graphics Arts , Thirteenth Annual Meeting, June 
1961, pp. 31-41, incorporated herein by 
reference. Clapper describes how to map the 
R,G,B density information into the C.M.Y color 
space by the construction of either a set of linear 
or polynomial equations and by solving the coeffi- 
cients thereof explicitly. However, this approach 
has the limitation that the number of equations and 
the number of coefficients (either linear or polyno- 
mial) must be matched. Hence, for a large number 
of color patches, this process will generate an 
unrealistically high order of equations, and the so- 



lution of the coefficients thereof may be very sen- 
sitive to the color patches being chosen. 

Therefore, in accordance with the present in- 
vention, all of these equations were cast into a 
s "least square error" problem whose advantage is 
that it is not now necessary to match the number of 
unknown polynomial coefficients with the number 
of equations which are a function of the number of 
color patches scanned. Thus, we are now free to 
io choose the type of mapping relationship to be 
used, and this least square solution is accom- 
plished as indicated below: 

The outline of obtaining H in equation (1) is as 
follows: Given TP jn , TP 0Ut and the functional rela- 
ys tionship for H, the task is to obtain a value for H 
such that the overall sum of squares of the error is 
minimized: 

Minimize E e' 2 = e J e = (TP in - H ■ TP oul ) T (TPm - 
H • TP oul ) 

20 This approach is known in the art as the least 

square minimization process, and is described, for 
example, in a well known classical textbook author- 
ed by Richard Bellman and entitled Introduction To 
Matrix Analysis , McGraw Hill Book Company Inc. 

25 1960, incorporated herein by reference. 

Various modifications may be made in the 
above-described embodiment without departing 
from the scope of this invention. For example, it is 
not necessary that the computers represented as 

30 62 and 88 in Rg. 4 be separate computers and 
instead these units 62 and 88 may both be part of 
single more complex computer. 



35 Claims 

1 . A method for matching the color of an image 
read by a color image scanner (10) and the printed 
hardcopy output of a copier or printer (18) con- 
40 trolled by the scanner (10), which comprises the 
steps of: 

a. providing a full scale color gamut (20, 44) 
based upon preselected parameters such as print 
media, inks, dyes, drop volumes and pen types, 
4 5 b. constructing an initial look up table (28) 

based upon said full scale color gamut (20, 44, Fig. 
5) and storing said initial look up table (28) in a 
computer, 

c. comparing a sample test pattern (Fig. 6) 
so of input information, T in , read by a scanner (10) 
with a test pattern of output information, TP out , 
generated by a color printer (18) or color copier to 
in turn generate (40) a corresponding transforma- 
tion matrix, H, and 
5 5 d. utilizing said transformation matrix H to 

continuously update (42) said initial look up table 
(28), so that the color differences between the 
image scanned by said color scanner (10) and the 
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hardcopy output of a color printer (18) or color 
copier are always driven toward zero, corrected 
and minimized. 

2. The method defined in claim 1 wherein the 
continuous updating of said look up table com- 5 
prises multiplying (84) a previously generated color 
conversion factor, F old , by said transformation ma- 
trix, H, to obtain an updated color conversion fac- 
tor, F new . 

3. A system for continuously matching the col- 10 
or of an image read by a color image scanner (10) 

and the printed hardcopy output of a copier or 
printer (18) controlled by the scanner (10) which 
comprises: 

a. color gamut means (20, 44) for providing 75 
a full scale color gamut (Fig. 5) based upon 
preselected parameters such as print media, inks, 
dyes, drop volumes and pen types, 

b. means (22) for reading said color gamut 
means (20) for constructing an initial look up table 20 
(28) based upon said full scale color gamut (Fig. 5) 

and for storing said initial look up table in memory. 

c. means (40) for comparing a sample test 
pattern of smaller color gamut (Fig. 5) input in- 
formation, TP in . read by a scanner (10) with a test 25 
pattern of output information. TP ou t. generated by a 
color printer (18) or color copier to thereby gen- 
erate a corresponding transformation factor, H. and 

d. means (42) for utilizing said transformation 
matrix, H, to continuously update said initial look up 30 
table, so that the color differences between the 
image scanned by said color scanner (10) and the 
hardcopy output of a color printer (18) or copier are 
always driven towards zero, corrected and mini- 
mized. 35 

4. The system defined in claim 3 which in- 
cludes: 

a. printer means (36) responsive to data 
stored in said initial look up table for generating 

said output information, TP oul , and *o 

b. computer means (40, 88) connected to 
said printer means (36) for receiving said TP out 
information and further connected to said color 
scanner (54) for receiving said TP in information (66) 

and for generating said transformation matrix, H, 45 

where TP in = H ■ TP ou t- 

5. The system defined in claim 4 wherein said 
computer means (88) further includes: 

a. means (84) for continuously updating a 
previously generated color conversion factor, F old . so 
to a newly updated color conversion factor, F new . 
where F new = H • F old . and 

b. means (86) for applying said updated 
color conversion factor F new to a color look up table 

for continuously updating said look up table which 55 
may be stored in memory (92). 
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© A method and system for continuously correct- 
ing for errors in color output of a color copier or 
printer (18) and caused by events that occur be- 
tween the input of a color image scanner (10) and 
the output of a copier or printer (18) driven thereby. 
This method and system includes, among other 
things, the continuous comparison (40) of input test 
pattern data, TP in , from a small color gamut (Fig. 6, 
30) or "patch" having only a selected few number of 
color pixels therein with the output test pattern data, 
TPout, from a color printer (18) or copier to generate 



(40) a color correction conversion factor, H. Then, H 
is used to continuously update (42, 86) an initial full 
scale look up table which was initially prepared from 
a full scale color gamut (Fig. 5). The initial look up 
table (28) has a color conversion factor, F D id. and H 
is used to convert F o!d to F new where F new - H • F Q | d 
In this manner (84), H continuously corrects for 
undesirable changes in parameters used to generate 
the initial look up table (28), such as quality of print 
media, ink, dye loading, ink drop volume, pen types 
and the calibration of system devices. 
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